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SYSTEM FOR EMBEDDING ADDITIONAL INFORMATION IN VIDEO DATA, 
AND EMBEDDING METHOD 



Abstract: 



It Is one object of the present invention to provide a method ..and system for 
embedding an electronic watermark directly in an MPEG stream. AConstitutionU 

An intra-macroblock of an l-frame or of a P or B-frame is detected in an MPEG 
stream, and following the detection of an intra-macroblock of the l-franne or of the 
P or B-frame, data for one macroblock are extracted from the MPEG stream and 
buffered An embedding pattern is embedded in the buffered macroblock without 
changing the length of VLC, and the resultant macroblock is returned to the 
MPEG stream. More specifically, a DC factor is extracted from the buffered 
macroblock, and a pseudorandom number is generated to Produce an 
embedding pattem. Then, whether the bit length of the DC factor will not be 
chanqed by embedding the obtained embedded pattem is determined. When the 
bit length of the DC factor not be changed, the embedding pattem is embedded 
in the buffered macroblock. When the bit length will be changed, whether 1/2 of 
the embedding pattern can be embedded is determined. If possible, 1/2 of the 
embedded pattern is embedded in the macroblock. 
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(54)Title: SYSTEM FOR EMBEDDING ADDITIONAL INFORMATION IN VIDEO DATA, AND EMBEDDING METHOD 



(57) Abstract 

An intra-block of the I-frame or P,B-frame is detected from an 
MPEG stream. When it is detected, one macro block of data is taken out 
from the MPEG stream and buffered. The buffered macro block is 
embedded with a pattern so that the length of the VLC may be invariant. 
The macro block embedded with a pattern is returned back to the MPEG 
stream. More specifically, the DC component is detected from the 
buffered macro block and a pseudo-random number is generated in 
order to generate a pattern to be embedded. It is judged whether or not 
the bit length of the DC component is invariant when the generated 
pattern is embedded. If the bit length is invariant, the pattern is 
embedded in the buffered macro block. When the bit length is varied, it 
is judged whether or not half of the pattern can be embedded. If 
possible, the pattern is embedded. ^ 
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\Z MPEG2 <D\iv'tT-^^^^^^'^^ VLC (Variable Length Code) 

tbjhtS^O^mtbX. x-iJ'A^X'f >^(IBM 
^I5tt€^S5J>^L.(Elelctornic Watermarking) t feU^lSn. Z.n^-7}V^ 

xn>K (baseband) ^m^iL^^ ^ (D^ JPEG/MPEG^ O ffi^ ^ T^^^tS 
<;)^t_^fi*,-Cag»S, ^ife JPEG \t Joint Photographic Coding Expers 
GroupW. MPEG \t Moving Picture Experts Group BST^.^. 

Tl±, #m¥8-159330 (lt[^^a#^JA9-96-044) > #I^¥8-273551 ( 
|^JA9-96-076) , it#P¥8-348426 (^JA9-96-090) . #IS¥9-088493 ( 
ISIJA9-97-045) , ii#lP3p9-248272(Pl JA9-97-156) . #M¥(I^JA9-96-07 
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(i, ,,.-rnfe'^-XA'>H^(7)iife3Z^^^^^^'^^'^- JPEG/MPEG^ 

J;Oi¥ilffllC{t. AC. M'^mi)^ VLC ^bLTV^^^!^. SJbiA^td^tC^S 
V^T. VLC (75 demultiplex, multiplex i3^>S!>^tM ^ fcT-yhXhU- 

|^5p8-272721(lBIJA9-96-074) TB.P f raine{:::}3tt ^'^^ 
i^j|ij=£^f^ LTMPEG2 1< 7^ f > (Cit^ffii632.t;^ii ^i^'?!^ ^ tlT 5 t!*^* . 
±i5(D<fc^lr VLCa)S^;ii^'^^-p-rL^'5:i.i:, B.P fraine(D/>/il^I«J 

^ j£ *5 J: rJ^ ^ X A * ^ -r S il T ^ § . 

i6 tj :^ j£ *5 ct X X A * -r ^ T ^ o 
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^fz3^\(Dum\t. B.p u&m(D'j^fs.\^W}mmzhi^^^m^^^ mpe 
G ^ com^^^Ti^ i> ^> ^ ^ ^ ^ ^ ^ * ^ " 

^ i:^{SM P E G tx^i-x-^-^^ntJ. *TMP E G X h U - A*^ 
^ I-fraie^fcli P.B-fra.e C7)^ > h 7 :/n ^ ^ 0^£B^^f V., Mra 
me^f'Ji P.B-fraaie (7)^ > h ^ :/a «y ^ Ti^^^tB^ nfc«^. MPEG 

/I ^ - >(7)a*5i^ ^ a :^ D ^ «^ M p E G <75 ;^ h u - ^ i^^t- , 

mt, Ss6ii^n^->^eK(7)fc*c7D»m^^^^^t^^- ^^^^ 
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k) (16x16 pi.ei)»ttr«»ii«n, ^immr.4-^<^m>t&^n^ 

-> (PO PI. P2. P3)S:Jf3. P0S:a*iittts5«tt. 
i,n:/p.y^»»««»<^W'"»<:sK»S+lL. ^imc&i^^-lV. Y2.T 

oe number - 1(0 orUin), n7P ^-nu»ber=iC91 0 ST e,n* 
a*a*Patter„ Ptt. P = P""." "^^^^n*. X. «PEG2»a^. 

^"^I-frame^itfi p.B-irame v^^n ^ \ y y 

7i7D7B.y91^»»t-. H^h'J-A<05t. YO « DC 6S»«SS» 

:f400(J. a»a*M^« DDSKVarlable length code) +DDD (dot Jc_si 
.e lu.lnaace)»bitft*tt^U *n6*'»l^V>»^- «• L 
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2, 3 tc M U T J^^fKAtT ^ « 

Len(D(i.j.Y))==Len(D(i.j.y) + A(M(i.j).Y)) ....^ (D 

:e(7)-7>7PyP7^CPM(i.j) ^m^'^tS, ^^-^^ D(i.j.Y){islice. 
nu.=i -7^aya.y^_nun.=j. subblock_nuin=YlC^tt ^ DC ^^^<D 
m. A(k.Y)tiffli65i^/1^->k(7) Y r.m^m<D^^<^m^^ Len(x) 

^To ^J^f^^ Len(O) = Lend) - 37:^0, DC^^^^ bT'O'Tfeo 
^subblock^TXtt'-l'-^^HT?>*tibit length75^'^*^e>/iV.fci?) 

Len(D(i.j.Y))==Len(D(i.j.Y) + A'(M(i.j).Y)) 
Len(D(iJ.Y))==Len(D(i.j.Y) + A"(M(i.i).Y)) •••• ^ 

^0'7^nya';'^t^P' M(i.j) XliP" M(iJ)SrSie>i2.t;. ccT, 

A ' (k Y) A ' • (k, Y) ji^n^ns*J2.*-/^i5'->kmicfett ^P'k, P' 
•kicmi-?>^<^EK^^*i^-^^^' ^(2)hmrc^nu^^^^^ 



wo 00/13414 



-7- 



PCT/JP98/05355 



m^mV^,^. ATA#x-i5'A^<7)^-^^^t^^'^^ li"^ bufferlCtS 
^r^m^^n-Do yD->^200li Line Buffer T^^. >^D«y^ 100 
T^frt^o^cx-^^t&^-r^A''y77-eS>^o ^O^y^'SOOti I-fram 
e^rc\t P.B-frame > h 7 ^^Higg-C^^o 200(7) 

5:_^^.t>, MPEG2 video stream^^ffib, MtC. I-frameSfeli P.B- 
frame (7)-^ > h 7 7a 7 ^ ^^tilT^. 7n^v^400Ji CCmm^ET 
^?>. z:(7)7P7^400ti, 2^^B^&7=-i5'A^7=^>^^ai^«;'7(Da 
taHiding*^" detection chii>)m\zm?^ih/vVm^r ^^^^^(D^'hmt 
;^i:^^fiT$)0, 7D>y^300TI-fraine=&^fcbL./t^> CCI<£^m-r^ 
^STfe§, ^D':/^400t± CCI*^aibfc^^> CPU interrupt 

;^{c7n^y^500liT^P7a':'^5^A*«y:7Tt?fe^c 7d ^500li 1 "7 
^^m^fi-^^-s- j:;i-e'7^D7py^(7)^A^?>DCo)^^fig^(Y=o.i 

.2.3)$^m-rs. 7P^y^7ooiiMa^^^^s-^*^- ^cT^^p^y 

CCT \^^U'7Uv'7\Z 2bit7i^-SiJO^Te,n^, fci^liMP@ML(72 
0x480) (75 720/16*480/16*2 = 2700bit<£:^^-r^. 7P>y^800 

DC Huffman tableTfe?). ^ ;iTMPEG2(DDC(7))^SfiK5><75huf fman ta 
ble(ISO/IEC 31818-2(OTableB.12)^*&^-r^o 7a^y^900li DC huff 
.an lengthit^^STfe^o g^Ji^^fr^^. DC(7.I1^^^(7)DDSL.D 
DD(75bit^75t^t^e>7^CV^7i^^5*^^5S-^'-^^®^^^-^' 7P7^1000 

DC Sffi*32.^ (re-embedding) ^ST^^, ^P-y^lOOOti, 7P 
>y/7900-Cbitg75^'Et^e>7iV^^^^ yp.y/7700T#e.n^cA-^->^ 
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32,;5^^(DT^d:/D7^^ bit stream {CMb. 9-^n7.\zmt^, 

i^mtUTco^m-vnOo I- frmemetecf^ntcn. DC(i.j.Y)^ DC 
(DUm^^ (iJ.Y(7)^^li-hlBffii6Ji^^fil^^l^)^ P(H(i.j).y)5: 
SJ632.^/^^-> (embedding pattern) M(l. j) miC^tf ^ffiJ^ii^ 

ADC(i.j) = DC{i.j.O)-DC(i.j.l) .M(i.j)=0 
DC(i. j.O)-DC(i. j.2) .M(i.j)=l 
DC(i. j.l)-DC(i. j.O) ,M(i.j)=2 
DC(i. j.2)-DC(i, j.O) ,M(i.j)=3 

ADC(i, j)/N — > 0 
({iUN ti ±|B2S(?)ft-^iC^tDnfeADC(iJ)W|!(T$.5) 

2i2jADC(i. j)/N -> A>0 
ADC(i. j)(^^*PMMa^ 

ct2 = ZiSj(ADC(iJ) - <ADC(i.j)»VN 

tLX. 

z =SjSjADC(i. j)/(a*N) 
^1, fe^thresholdTtr^b, T<*z;^J:e>«Si6ii^fi"Yes". T>=z^^e, 
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O (i^M^ ^ - cfc -5 W^sfSfej^^ ^ I i T 1 0 (7) ^i^lj <Jr fF Pl 
■r§*<75ai3f5'5>';^7^A<^^51iO^*^^nTVi^ (DVD CPTWG DHSG CFP V 

mM^mX'fV^y^^-^ii^^^ZX = a, O) (copy Once)56?^ai$nfc 
ff:'t7^cCCI (Extended CC I, ^TECCI) OWi^SriliS b> "ECClT^cL 
" (^^^ttECCI<£:ai63i»IS®^fF^T^o "ECCI^O" O^-^ti^H 

H^(7):^^^i^Ati. CopyllHl(7)^pJ(73>';^xA^||Jim5!5'&c ^BStd 

X fc'x ;f CD gem ^ M i -3 ;^ X ^isK (D f f| o 

x>^^Jl^®fl7=-i$':6^\ :/O»yi^510(?5STB (Set Top Box) T^^i^n, 
■?-(Dx~:$'7&^*lili^fi570(CA;'7$n'5<h. ^1*^0^^520^ CCICO^ 
m^rfrV^. ^^^tifz.^^. yuy^SZOX ECCI i: 5 Ti^^iili^ 

$n^, C^X. ECCI;5^*0 (YES) thflj^^nfe^-g-fiyn >;/i7 56 
0"r^li:f5^*^±$n^. fcL ECCl7&^;^j:ltn{i:/P «y ^540T ECCK^ffiai 

1. MPEG2 H^-l'>±-C(DiJ7;UiJ''f A(7)ECCI ffiJ6j2i^7&^* BTt^Tfe 0 , 
■ec^I^yi^^y hft^n^cDYD format fct) S C i:, 

2. MPEG2^|||^Lfc^<7)'^-xn> H, DA^t^<&fTc> fc^(7)7:^0 H 
>-r> (Analog domain) 75^e>(7)^mfc BjggTSSJ: i:„ 

4. #M¥9-0884937^i: ^ (Dlokenm'Cmm tfJi^MmB^lZis^-f^JL^- 
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m M m m 

5 (2) ttiBMmyi'-i^fi^^B^nrzm'^s m^nmyu-i.f)^^A^m 

( 4 ) ftiJPif ^WSJ6jit nfc/hM*^* t'x:tx-iS^ l3Mt-^iS:i:> 
(7)->Xx A. 

3. BfriHM^7l/-A755MPEGt:x:tx-i$'<75 I-frame ^fcti P.B- 
15 frame <D^ > hyZro-j^X'^}^. |f^^2 IHiKOi^ XxAo 

(3 b) nmmn^mitihM^z. mEDc^^(D\iy hm^^^-v$> 

20 (3 c) h:R75^'T^<75^'^, #]!jPlf^^A'7 77 U >^$nfe 

5. t5E#Jnff^^ai6iity¥^ (3) 75^ ^^tC 

(3d) ttiB\iv h&^mitbtzm^^ nmmmm<Di/2f)mit)jhib 
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6. Mmmmm^^ mmm^'o%ibn^msb^p^/-^^->T$,^. 

(1) t*x:tx-^$'7i)^^®^7 lx-A(D^m^fT^@Pii:> 

(2) ^E®^7 l/-A75^*^tB$n;^ci®-a-. tifEiii^7 l/-A;0^^/hM 

(3) BifEA*«y77U>^^n?^c/hM^tC, lf7=:t-7=-iS^X h •J-A<75 

o , 

9. MP EGX h iJ-A^mi=^M75^L<&Si6j2itr:^?*T$.-:>T, 

(1) MPEGX hU-A3{/^^ I-frame ^Ac^i P.B-fraine (7)-f>h^ 

(2) tfrEI-frame Sfcfi P.B-frame W-f > h 77'n n 
fci^-^, MIBMPEGX hU-A75^^>l "7 ^ D 7^0 >y ^ ^^-cT^x- iS' ^® 
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(3) |(rEA*777'J>'^$nfeT^O>^P«yi:7(C. VLC(D^-^f)i^ 

\zmrmmt. 

(1) \i'fyi:9--^is^^M^yv-h(Di^^^^DWL^t. 
10 (3) H>fE/V)/7 7 U>^$nfc/hM^4'lc#SPlf^75^fe^75^^^mT 

1 1. MP EG7. h U-Aff (7)«i^S75^L^^£B-r^:^ST$)-pT, 

(1) MP EG7. h U-A;0^e I-frame ^Acfi P.B-frame 
15 7o^y ^(D^m^fra^Pit, 

(2) MEI-frame^^cti P.B-frame (7)-f > h ^7'n «y i^7j>^^m$n^c 

(3) MEA'y77 U>i/$n^cT^D7'D'yi:7Pf>(7)DC£!K:^lcSJ65Zi 
^m-t^'lt^^WLt-t^. MP E G€i^it75^b^ai:^So 

(1) X:t?x-i5'*^e)CC I ^^mr^^s:*!:, 

(2) cci75mai$n^#'&. A^x-i5'75^e>Ecci ^^m-r^^ 

25 ©i:, 

(3) ECCl75^*^ffi$nfc^-&. xv'iJ^;!^ • ■r-iS'(75^iJl5:^±r^ 
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(4) ECC libmHii^nUl^^'^^ -rv^^JV • x-iS'^ECC I SrS 
10 (3) ^iaA*-y77U>^^tlfc/h^^fw, \iy':ty'-^7.h^)-A(D 

( 4 ) #j!jpif n^c/h^^^ t'7=^7=-r5^ tcM-rm^gi. 

o 

20 (3) t&iSA*^y77U>^/^nfc/hM^^{-mnfS^75^^^7!?^^^m-r 
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